Identifying an end of a television program

ABSTRACT

A system, computer-readable storage medium storing at least one program, and a computer-implemented method for identifying an end of a television program is described. During a scheduled presentation of a television program, a determination is made that the television program is within a predetermined time interval including a time when the television program is scheduled to end. Subtitles for the television program are monitored during the predetermined time interval. When a sequence of strings in the subtitles corresponds to a known sequence of strings in an aggregation of subtitles indicating that the television program has ended, at least one client device is notified that the television program has ended.

TECHNICAL FIELD

The disclosed implementations relate generally to identifying an end ofa television program.

BACKGROUND

Television programs are scheduled to start and end at predeterminedtimes. However, an actual start of a television program may occur beforeor after a scheduled start time and an actual end of the televisionprogram may occur before or after a scheduled end time. For example, anend of a live television event (e.g., an awards show) may occur at atime that is later than a scheduled ending time. It is desirable toidentify an end of a television program so that appropriate actions maybe taken.

BRIEF DESCRIPTION OF THE DRAWINGS

The implementations disclosed herein are illustrated by way of example,and not by way of limitation, in the figures of the accompanyingdrawings. Like reference numerals refer to corresponding partsthroughout the drawings.

FIG. 1 is a block diagram illustrating an example network system,according to some implementations.

FIG. 2 is a block diagram illustrating an example process of obtainingsequences of strings in subtitles indicating that a television programhas ended, according to some implementations.

FIG. 3 is a block diagram illustrating an example process of identifyingan end of a television program, according to some implementations.

FIG. 4 is a block diagram illustrating an example process of providingsequences of strings in subtitles indicating that a television programhas ended to a client device, according to some implementations.

FIG. 5 is a block diagram illustrating an example server, according tosome implementations.

FIG. 6 is a block diagram illustrating an example client device,according to some implementations.

FIG. 7 is a flowchart of a method for identifying an end of a televisionprogram, according to some implementations.

FIG. 8 is a flowchart of a method for monitoring subtitles for atelevision program during a predetermined time interval, according tosome implementations.

FIG. 9 is a flowchart of a method for obtaining subtitles from atelevision signal, according to some implementations.

FIG. 10 is a flowchart of a method for determining a time when atelevision program is scheduled to end, according to someimplementations.

FIG. 11 is a flowchart of a method for identifying sequences of stringsin the subtitles indicating that the television program has ended,according to some implementations.

DETAILED DESCRIPTION

The times when a television program is scheduled to start and end may beobtained from an electronic programming guide (EPG). However, the timeswhen a television program actually starts and ends may be different thanthe times when the television program is scheduled to start and end. Forexample, the information in the EPG assumes that the television programdoes not start until a previous television program ends and thetelevision program does not end until a next television program starts.Thus, a time period in which the television program is scheduled to airincludes not only the television program itself, but may also includecommercials before and after the actual start and end of the televisionprogram. In another example, the television program may start (or end)earlier and/or later than scheduled due to various factors (e.g., theprevious television program ends later than scheduled, a news eventdelays a time when the television program actually starts, thetelevision program is a live event that runs past a time when thetelevision program is scheduled to end, etc.).

Knowing when a television program has ended is useful for severalreasons. For example, the end of a television program includes a timewhen a viewer may start searching for another television program towatch. Thus, the end of the television program is a desirable time torecommend another television program to the viewer. In another example,the end of a television program includes a time when a viewer may searchfor information related to the television program. Thus, the end of thetelevision program is a desirable time to recommend and/or presentcontent related to the television program to the viewer. In anotherexample, a digital video recorder (DVR) may miss the end of a televisionprogram if the television program runs past the scheduled end time.Thus, the DVR may be instructed to extend a scheduled recording of thetelevision program the end of the television program (i.e., the actualend of the television program) has been determined. In another example,a DVR may continue to record a television program until a time when thetelevision program is scheduled to end (e.g., until a time when a nexttelevision program is scheduled to start) even though the televisionprogram has ended. In other words, the DVR may record the commercialsthat air in a time period between the actual end of the televisionprogram and a time when the next television program is scheduled tostart. Thus, a DVR may be instructed to stop recording a televisionprogram after the end of the television program has been determined(e.g., to avoid the recording of the commercials that air in the timeperiod between the actual end of the television program and the timewhen the next television program is scheduled to start).

The implementations described herein provide techniques for identifyingan end of a television program.

FIG. 1 is a block diagram illustrating a network system 100, accordingto some implementations. The network system 100 includes a client device102, a server 110, and a metadata provider 106 coupled to a data network120. The data network 120 may generally include any type of wired orwireless communication channel capable of coupling together computingnodes. This includes, but is not limited to, a local area network, awide area network, or a combination of networks. In some embodiments,the data network 120 includes the Internet.

The network system 100 also includes a TV broadcaster 104 thatbroadcasts television programs through a TV network 121 to the clientdevice 102 and/or the server 110. The TV network 121 may generallyinclude any type of wired or wireless communication channel capable oftransmitting television signals. This includes, but is not limited to,an over-the-air television network, a cable television network, asatellite television network. In some implementations, the TVbroadcaster 104 broadcasts television programs using the data network120 (e.g., using an Internet Television protocol).

In some implementations, the television programs broadcast by the TVbroadcaster 104 include subtitles. Note that the term “subtitles” refersto a sequence of strings (e.g., text) that is displayed in conjunctionwith (or associated with) a sequence of video frames of a televisionprogram (e.g., the sequence of video frames that includes the respectivesequence of strings) and corresponds to dialog being presented duringthe sequence of video frames. In some implementations, the subtitles arein the same language as the dialog. In some implementations, thesubtitles are in a different language than the dialog. The term“subtitles” is also synonymous with the term “closed captioning.” Forexample, a first subtitle “I can't believe you said that” may bedisplayed in conjunction with a first sequence of video frames of atelevision program and a second subtitle “What are you talking about?”may be displayed in conjunction with a second sequence of video framesof a television program. In some implementations, the TV broadcaster 104includes a single television network station, multiple relatedtelevision network stations (e.g., affiliate television stations,television stations owned by the same entity, etc.), and a televisionservice program (e.g., a cable television service provider, a satellitetelevision service provider, etc.). As discussed above, the TVbroadcaster 104 typically broadcasts the television programs using apredetermined broadcast schedule that indicates times when thetelevision programs are scheduled to start and end.

In some implementations, the client device 102 includes a digital videorecorder (DVR), a television set top box (e.g., a cable television settop box, a satellite television set top box, an over-the-air televisionset top box, an Internet Protocol television set top box, etc.), atelevision metering box, or any other computer system (e.g., laptop,desktop, server, mobile electronic device, smartphone, tablet, etc.)that is configured to present and/or record a television programs.

In some implementations, the server 110 monitors subtitles fortelevision programs to identify sequences of strings in the subtitlesthat correspond to known sequences of strings in subtitles indicatingthat the television programs have ended. The server 110 then notifiesthe client device 102 that the television programs have ended. In someimplementations, the server 110 monitors subtitles for televisionprograms to identify sequences of strings indicating that the televisionprogram has ended. The server 110 then provides the sequences of stringsindicating that the television program has ended to the client device102 so that the client device 102 can detect and end of the televisionprogram. These implementations are described in more detail below.

In some implementations, the metadata provider 106 provides, via datanetwork 120, information relating to television programs to the clientdevice 102 and/or the server 110. In some implementations, a TVbroadcaster 104 provides, via the TV network 121, the informationrelating to television programs to the client device 102 and/or theserver 110. The information relating to a respective television programincludes, but is not limited to, a title of the respective televisionprogram, a synopsis of the respective television program, actors in therespective television program, a respective series to which therespective television program belongs, an episode number for therespective television program, a respective channel on which therespective television program is broadcast, and a scheduled start andend time for the respective television program. In some implementations,the information relating to television programs is included in anelectronic program guide (EPG).

Note that although FIG. 1 shows one instance of the server 110, multipleservers may be present in the network system 100. For example, theserver 110 may include a plurality of distributed servers. The pluralityof distributed servers may provide load balancing and/or may providelow-latency points of access to nearby computer systems. The distributedservers may be located within a single location (e.g., a data center, abuilding, etc.) or may be geographically distributed across multiplelocations (e.g., data centers at various geographical locations, etc.).

Also note that although the embodiments described herein refer to theclient device 102, the TV broadcaster 104, the server 110, and themetadata provider 106, the embodiments may be applied to multiple clientdevices, TV broadcasters, servers, and metadata providers.

FIG. 2 is a block diagram 200 illustrating an example process ofobtaining sequences of strings in subtitles indicating that a televisionprogram has ended, according to some implementations. The TV broadcaster104 transmits, via the TV network 121 (or the data network 120), TVsignals 210 on which a plurality of television programs are broadcast.For example, the TV signals 210 may correspond to TV programs that arecurrently being broadcast by the TV broadcaster 104. In someimplementations, the TV signals 210 include digital TV signals. Forexample, the digital TV signals may conform to the Digital VideoBroadcasting (DVB) standard or the Advanced Television Systems Committee(ATSC) standards. In some implementations, the TV signals 210 includeanalog TV signals.

In some implementations, the server 110 obtains (and/or captures) aparticular television program from a particular TV signal in the TVsignals 210 using a TV signal tuning (and/or capture) device that isexternal to the server 110. In some implementations, the server 110includes a TV signal tuning (and/or capture) device that obtains (and/orcaptures) a particular television program from a particular TV signal inthe TV signals 210. In some implementations, the TV signal tuning(and/or capture) device obtains a particular television program from aparticular carrier frequency in the TV signals 210. In implementationswhere the TV signals 210 include digital TV signals, the TV signaltuning (and/or capture) device includes a DVB and/or an ATSC TV tuning(and/or capture) device. In implementations where the TV signals 210include analog TV signals, the TV signal tuning (and/or capture) deviceincludes an analog TV tuning (and/or capture device). In someimplementations, the server 110 includes a TV signal tuning (and/orcapture) device for each TV signal in the TV signals 210. For example,the server 110 may include a TV signal tuning (and/or capture) devicefor each carrier frequency on which television programs are broadcast.Note that a particular carrier frequency is typically assigned to aparticular TV broadcaster (e.g., a TV station). Furthermore, in someimplementations, the particular TV broadcaster is associated withmultiple carrier frequencies. For example, the particular TV broadcastermay be associated with a first carrier frequency on an over-the-air TVnetwork, a second carrier frequency on an analog cable TV network, athird carrier frequency on a digital cable TV network, and so on.

A subtitle module 202 of the server 110 receives the TV signals 210 fromthe TV signal tuning (and/or capture device). In some implementations,the subtitle module 202 receives scheduled end times 212 of thetelevision program from the metadata provider 106. In someimplementations, the scheduled end times 212 are included in metadatathat is received from the metadata provider 106 (and/or other metadataproviders) that is processed and stored in a database 206 (or otherdatabase) of the server 110. In these implementations, the scheduled endtimes 212 are obtained from the database 206 (or other database). Insome implementations, the subtitle module 202 obtains subtitles 214 forthe television programs corresponding to the TV signals 210 during apredetermined time interval including a time when the televisionprograms are scheduled to end (e.g., scheduled end times 212 that areobtained from the metadata provider 106). For example, the predeterminedtime interval may include a time interval spanning five minutes beforeand after a scheduled end of a television program. The subtitles 214include sequences of strings that correspond to the dialog of thetelevision programs. The subtitles for a particular television signalmay be transmitted using several techniques. For the DVB standard,subtitles may be transmitted using two techniques. In the firsttechnique, the subtitles are transmitted as sequences of bitmaps in aprivate data stream, as specified in European TelecommunicationsStandards Institute (ETSI) European Standard, telecommunications series(EN) 300 743. For subtitles transmitted using this technique, thesubtitle module 202 uses an optical character recognition technique(OCR) to extract the sequences of strings from the sequences of bitmaps.In the second technique, the subtitles are transmitted in text format asteletext subtitles, as specified in ETSI 300 706. For subtitlestransmitted using this technique, the subtitle module 202 obtains thesequences of strings from the teletext subtitles. For the ATSC standard,subtitles may be transmitted as Electronic Industries Alliance (EIA) 608or Consumer Electronics Association (CEA) 708 closed captions insideMPEG-2 user data sections of the MPEG-2 video stream. Since EIA 608 andCEA 708 are text formats, the subtitle module 202 obtains sequences ofstrings from the user data sections of the MPEG-2 video stream. Foranalog TV signals in the United States and Canada, subtitles areinserted into line 21 of the non-visible vertical blanking interval(VBI) of the analog video signal, as specified EIA 608. For analog TVsignals in Europe, teletext subtitles are inserted into lines 7-22 or320-335 of the video signal, as specified in ETSI 300 706. Note that thediscussion above provides a few example techniques of transmittingsubtitles. When other techniques of transmitting subtitles are used, thesubtitle module 202 uses the appropriate extraction techniques to obtainthe subtitles 214 from the TV signals 210. For example, when the TVsignals 210 include Internet Protocol TV signals, the server 110 obtainsthe TV signals from the servers streaming the Internet Protocol TVsignals. The subtitle module 202 then obtains the subtitles 214 from theInternet Protocol TV signals using appropriate techniques.

In some implementations, the subtitle module 202 stores the subtitles214 (e.g., sequences of strings) in the database 206. In theseimplementations, a record for a respective subtitle includes arespective sequence of strings for the respective subtitle, a timestampindicating a time when the respective subtitle was transmitted, optionalstyle information for the respective subtitle (e.g., bold, italics,underline, etc.), optional font information for the respective subtitle,and optional color information for the respective subtitle.

Subtitles at the end of a television program typically include stringsthat identify the end of the television program. For example, thesubtitles at the end of the program may indicate the entity thatprovided the subtitles (e.g., “NATIONAL CAPTIONING INSTITUTE,”“CAPTIONING MADE POSSIBLE BY WARNER BROS. DOMESTIC TELEVISIONDISTRIBUTION,” etc.). In some implementations, an end detection module204 of the server 110 obtains the subtitles 214 from the database 206and identifies sequences of strings 216 that occur in at least apredetermined percentage of the plurality of television programs. Forexample, the end detection module 204 may identify the sequences ofstrings 216 as sequences of strings having at least a predeterminedminimum length (e.g., five words) and occurring at least thepredetermined percentage (e.g., 10%) of subtitles of the plurality oftelevision programs. The sequences of strings 216 that occur in at leastthe predetermined percentage of the plurality of television programs arelikely to be sequences of strings that indicate that a televisionprogram has ended. In some implementations, an end detection module 204of the server 110 obtains the subtitles 214 from the database 206 andidentifies sequences of strings 216 that occur in at least apredetermined number of the plurality of television programs during thepredetermined time interval including the time when the televisionprograms are scheduled to end. For example, the end detection module 204may identify the sequences of strings 216 as sequences of strings thatoccur in the subtitles in the last 10 minutes of at least 15 differenttelevision programs. In some implementations, the subtitles 214 that theend detection module 204 obtains from the database 206 only include thesubtitles for television programs that were broadcast within apredetermined number of days. For example, the subtitles 214 onlyinclude the subtitles for television programs that were broadcast withinthe past five days. Recall that since the subtitles 214 include thesubtitles that were obtained during the predetermined time interval(i.e., the time interval including a time when the television program isscheduled to end), the sequences of strings 216 are also included in thepredetermined time interval. The end detection module 204 stores thesequences of strings to the database 206.

In some implementations, the process described above with reference toFIG. 2 is performed continuously for each (or a subset of) thetelevision programs being broadcast by the TV broadcaster 104 (and/orother TV broadcasters). For example, the server 110 may continuouslymonitor TV signals 310 across all TV broadcasters to obtain thesequences of strings 216 indicating that a television program has ended.In these implementations, the subtitle module 202 obtains subtitles forthe television programs corresponding to the TV signals broadcast by theTV broadcasters during the predetermined time interval including thetimes when the television programs are scheduled to end. The subtitlemodule 202 stores these subtitles in the database 206. In someimplementations, the end detection module 204 periodically obtains thesubtitles from the database 206 (e.g., all or a subset of the subtitlesthat have been collected across a plurality of television programs thathave previously been broadcast) and identifies sequences of strings thatoccur in at least a predetermined percentage of the plurality oftelevision programs. For example, the end detection module 204 mayobtain the subtitles from the database 206 and identify sequences ofstrings that occur in at least a predetermined percentage of theplurality of television programs every two days.

In some implementations, after identifying the sequences of strings 216,the server 110 uses the identified sequence of strings to identify anend of a television program that is currently being broadcast by the TVbroadcaster 104. FIG. 3 is a block diagram 300 illustrating an exampleprocess of identifying an end of a television program, according to someimplementations. A TV signal tuning (and/or capture) device of theserver 110 obtains (and/or captures) a TV signal 310 corresponding to atelevision program. The subtitle module 202 of the server 110 receivesthe TV signals 310 from the TV signal tuning (and/or capture device). Insome implementations, the subtitle module 202 receives a scheduled endtime 312 of the television program from the metadata provider 106. Insome implementations, the scheduled end time 312 is included in metadatathat is received from the metadata provider 106 (and/or other metadataproviders) that is processed and stored in the database 206 (or otherdatabase) of the server 110. In these implementations, the scheduled endtime 312 is obtained from the database 206 (or other database). Thesubtitle module 202 then obtains subtitles 314 for the televisionprograms corresponding to the TV signals 210 during a predetermined timeinterval including a time when the television programs are scheduled toend (e.g., scheduled end times 212 that are obtained from the metadataprovider 106). The end detection module 204 compares sequences ofstrings in the subtitles 314 to the sequences of strings 216 indicatingthat a television program has ended to identify an end of the televisionprogram.

In some implementations, after identifying the end of the televisionprogram, the end detection module 204 transmits a notification 302 tothe client device 102 indicating that the television program has ended.The client device 102 then performs an appropriate action. For example,the client device 102 may stop recording the television program. Inanother example, the client device may obtain and present informationrelating to the television program.

In some implementations, the process discussed with reference to FIG. 2is performed in parallel with the process discussed with reference toFIG. 3. In other words, while the server 110 is identifying an end of aparticular television program (e.g., the process described withreference to FIG. 3), the server 110 is also identifying (adding, orrefining) the sequences of strings 216 indicating that a televisionprogram has ended (e.g., the process described with reference to FIG.2).

In the process discussed with reference to FIG. 3, the server 110identifies an end of a television program. In some implementations, theclient device 102 performs the operations discussed with reference toFIG. 3. In these implementations, the server 110 provides the sequencesof strings 216 to the client device 102 (periodically and/or when thesequences of strings 216 are updated), as illustrated in FIG. 4, so thatthe client device 102 can identify the end of television programs asdiscussed with reference to FIG. 3. In some implementations, the server110 provides the client device 102 with access to the database 206 sothat the client device 102 can use the sequences of strings 216 toidentify the end of television programs as discussed with reference toFIG. 3.

FIG. 5 is a block diagram illustrating the server 110, according to someimplementations. The server 110 typically includes one or moreprocessing units (CPU's, sometimes called processors) 502 for executingprograms (e.g., programs stored in memory 510), one or more network orother communications interfaces 504, memory 510, and one or morecommunication buses 509 for interconnecting these components. The server110 also includes a TV signal tuning device 503 that obtains (and/orcaptures) television programs from TV signals. The communication buses509 may include circuitry (sometimes called a chipset) thatinterconnects and controls communications between system components. Theserver 110 optionally includes (but typically does not include) a userinterface 505 comprising a display device 506 and input devices 508(e.g., keyboard, mouse, touch screen, keypads, etc.). Memory 510includes high-speed random access memory, such as DRAM, SRAM, DDR RAM orother random access solid state memory devices; and typically includesnon-volatile memory, such as one or more magnetic disk storage devices,optical disk storage devices, flash memory devices, or othernon-volatile solid state storage devices. Memory 510 optionally includesone or more storage devices remotely located from the CPU(s) 502. Memory510, or alternately the non-volatile memory device(s) within memory 510,comprises a non-transitory computer readable storage medium. In someimplementations, memory 510 or the computer readable storage medium ofmemory 510 stores the following programs, modules and data structures,or a subset thereof:

-   -   an operating system 512 that includes procedures for handling        various basic system services and for performing hardware        dependent tasks;    -   a communication module 514 that is used for connecting the        server 110 to other computers via the one or more communication        interfaces 504 (wired or wireless) and one or more communication        networks, such as the Internet, other wide area networks, local        area networks, metropolitan area networks, and so on;    -   an optional user interface module 516 that receives commands        from the user via the input devices 508 and generates user        interface objects in the display device 506;    -   the subtitle module 202 that obtains subtitles for television        programs during a predetermined time interval including a time        when the television programs are scheduled to end, as described        herein;    -   the end detection module 204 that identifies sequences of        strings indicating that a television program has ended and that        identifies an end of a television program, as described herein;        and    -   the database 206, which includes sequences of strings 518        indicating that a television program has ended, where the        sequences of strings 518 include the sequences of strings 216,        as described herein.

In some implementations, the programs or modules identified abovecorrespond to sets instructions for performing a function describedabove. The sets of instructions can be executed by one or moreprocessors (e.g., the CPUs 502). The above identified modules orprograms (i.e., sets of instructions) need not be implemented asseparate software programs, procedures or modules, and thus varioussubsets of these programs or modules may be combined or otherwisere-arranged in various implementations. In some implementations, memory510 stores a subset of the modules and data structures identified above.Furthermore, memory 510 may store additional modules and data structuresnot described above.

Although FIG. 5 shows a “server,” FIG. 5 is intended more as functionaldescription of the various features which may be present in a set ofservers than as a structural schematic of the implementations describedherein. In practice, and as recognized by those of ordinary skill in theart, items shown separately could be combined and some items could beseparated. For example, some items shown separately in FIG. 5 could beimplemented on single servers and single items could be implemented byone or more servers. The actual number of servers used to implement theserver 110 and how features are allocated among them will vary from oneimplementation to another, and may depend in part on the amount of datatraffic that the system must handle during peak usage periods as well asduring average usage periods.

FIG. 6 is a block diagram illustrating the client device 102, accordingto some implementations. The client device 102 typically includes one ormore processing units (CPU's, sometimes called processors) 602 forexecuting programs (e.g., programs stored in memory 610), one or morenetwork or other communications interfaces 604, memory 610, the inputdevice port 302, the control devices 303, the input ports 304, theoutput ports 305, and one or more communication buses 609 forinterconnecting these components. The server 110 also includes a TVsignal tuning device that obtains (and/or captures) television programsfrom TV signals. The client device 102 also includes a TV signal tuningdevice 603 that obtains (and/or captures) television programs from TVsignals. The communication buses 609 may include circuitry (sometimescalled a chipset) that interconnects and controls communications betweensystem components. Memory 610 includes high-speed random access memory,such as DRAM, SRAM, DDR RAM or other random access solid state memorydevices; and typically includes non-volatile memory, such as one or moremagnetic disk storage devices, optical disk storage devices, flashmemory devices, or other non-volatile solid state storage devices.Memory 610 optionally includes one or more storage devices remotelylocated from the CPU(s) 602. Memory 610, or alternately the non-volatilememory device(s) within memory 610, comprises a non-transitory computerreadable storage medium. In some implementations, memory 610 or thecomputer readable storage medium of memory 610 stores the followingprograms, modules and data structures, or a subset thereof:

-   -   an operating system 612 that includes procedures for handling        various basic system services and for performing hardware        dependent tasks;    -   a communication module 614 that is used for connecting the        client device 102 to other computers via the one or more        communication interfaces 604 (wired or wireless) and one or more        communication networks, such as the Internet, other wide area        networks, local area networks, metropolitan area networks, and        so on;    -   a user interface module 616 that receives commands from the user        via the input devices 608 and generates user interface objects        on the display device 608; and    -   the subtitle module 202 that obtains subtitles for television        programs during a predetermined time interval including a time        when the television programs are scheduled to end, as described        herein;    -   the end detection module 204 that identifies sequences of        strings indicating that a television program has ended and that        identifies an end of a television program, as described herein;        and    -   a database access module 618 that provides an interface for the        client device 102 to access (e.g., select, create, update,        delete, etc.) a database (e.g., the database 206 of the server        110); and    -   applications 620 that provide additional functionality to the        client device 102 (e.g., a web browser, television application,        etc.).

In some implementations, the programs or modules identified abovecorrespond to sets instructions for performing a function describedabove. The sets of instructions can be executed by one or moreprocessors (e.g., the CPUs 602). The above identified modules orprograms (i.e., sets of instructions) need not be implemented asseparate software programs, procedures or modules, and thus varioussubsets of these programs or modules may be combined or otherwisere-arranged in various implementations. In some implementations, memory610 stores a subset of the modules and data structures identified above.Furthermore, memory 610 may store additional modules and data structuresnot described above.

Although FIG. 6 shows a “client device,” FIG. 6 is intended more asfunctional description of the various features which may be present in aclient device than as a structural schematic of the implementationsdescribed herein. In practice, and as recognized by those of ordinaryskill in the art, items shown separately could be combined and someitems could be separated.

Identifying an End of a Television Program

The following discussion refers to the subtitle module 202 and the enddetection module 204 of the server 110 performing particular operations.However, the operations discussed below may be performed by othermodules of the server 110. Furthermore, the functionality of thesubtitle module 202 and the end detection module 204 may be combinedinto a single module or may be partitioned further into sub-modules (ormultiple modules).

FIG. 7 is a flowchart of a method for identifying an end of a televisionprogram, according to some implementations. During a scheduledpresentation of a television program, the end detection module 204determines (702) that the television program is within a predeterminedtime interval including a time when the television program is scheduledto end. The end detection module 204 monitors (704) subtitles for thetelevision program during the predetermined time interval. Operation 704is described in more detail below with reference to FIG. 8. When asequence of strings in the subtitles corresponds to a known sequence ofstrings in an aggregation of subtitles indicating that the televisionprogram has ended, the end detection module 204 notifies (706) at leastone client device (e.g., the client device 102) that the televisionprogram has ended.

FIG. 8 is a flowchart of a method for monitoring (704) subtitles for atelevision program during a predetermined time interval, according tosome implementations. The end detection module 204 obtains (802)subtitles (e.g., the subtitles 314) from a television signal on whichthe television program is being broadcast, identifies (804) sequences ofstrings in the subtitles, and compares (806) the sequences of strings inthe subtitles to known sequences of strings in the aggregation ofsubtitles that indicate that a respective television program has ended(e.g., the sequences of strings 216).

In some implementations, the subtitles for the television program areincluded in a text stream of the television signal. In theseimplementations, the end detection module 204 obtains the subtitles fromthe television signal from the subtitle module 202. Specifically, thesubtitle module 202 extracts the subtitles from the text stream andprovides the extracted subtitles to the end detection module 204.

In some implementations, the subtitles for the television program areincluded in an image stream of the television signal (e.g., a sequenceof bitmaps as specified in ETSI EN 300 743, an analog video signal,etc.). FIG. 9 is a flowchart of a method for obtaining (802) subtitlesfrom a television signal, according to some implementations. Thesubtitle module 202 obtains (902) images from the image stream andperforms (904) optical character recognition on the images to obtain thesubtitles from the images. The subtitle module 202 then provides thesubtitles to the end detection module 204.

In some implementations, the known sequence of strings (e.g., thesequence of strings 216) in the aggregation of subtitles is stored in adatabase (e.g., the database 206).

Prior determining (702) that the television program is within apredetermined time interval including the time when the televisionprogram is scheduled to end, the end detection module 204 determines atime when the television program is scheduled to end, as illustrated inFIG. 10. The end detection module 204 obtains (1002) metadata for thetelevision program and determines (1004) the time when the televisionprogram is scheduled to end from the metadata for the televisionprogram.

As discussed above, the end detection module 204 identifies (e.g.,periodically identifies) sequences of strings indicating that atelevision program has ended. FIG. 11 is a flowchart of a method foridentifying sequences of strings in the subtitles indicating that thetelevision program has ended, according to some implementations.

The end detection module 204 periodically obtains (1102) subtitles for aplurality of television programs during the predetermined time intervalthat include respective times when respective television programs in theplurality of television programs are scheduled to end. For example, thepredetermined time interval may include a time period m minutes beforeand n minutes after a time that the television program is scheduled toend. In some implementations, the plurality of television programs onlyincludes television programs that were broadcast within a predeterminednumber of days. For example, the plurality of television programs mayinclude television programs that were broadcast within the past fivedays. In some implementations, the end detection module 204 identifies(1104) sequences of strings (e.g., the sequences of strings 216) fromthe subtitles for the plurality of television programs that occur in atleast a predetermined percentage of the plurality of television programs(during the predetermined time interval that include respective timeswhen respective television programs in the plurality of televisionprograms are scheduled to end). In some implementations, the enddetection module 204 of the server 110 identifies (1104) sequences ofstrings (e.g., the sequences of strings 216) from the subtitles for theplurality of television programs that occur in at least a predeterminednumber of the plurality of television programs (during the predeterminedtime interval that include respective times when respective televisionprograms in the plurality of television programs are scheduled to end).The end detection module 204 then updates (1106) a database (e.g., thedatabase 206) including known sequences of strings in the aggregation ofsubtitles that indicate that a respective television program has endedwith the identified sequences of strings.

In some implementations, instead of updating the database with theidentified sequences of strings, the end detection module 204 updatesthe database with hash values of the identified sequences of strings. Insome implementations, the hash values are obtained by applying a hashfunction (e.g., MD5, SHA1, etc.) to the identified sequences of strings.In these implementations, in operation 806, the end detection module 204(of the server 110 or the client device 102) compares hash valuescorresponding to the sequences of strings in the subtitles to hashvalues corresponding to the known sequences of strings in theaggregation of subtitles that indicate that a respective televisionprogram has ended.

In some implementations, the client device 102 performs the operationsdescribed above with reference to FIGS. 7-10. In these implementations,the server 110 provides, to the client device 102, the sequences ofstrings indicating that a television program has ended. For example, theserver 110 may periodically transmit the sequences of strings 216 to theclient device 102. In another example, the server 110 provides theclient device 102 with access to the database 206 so that the clientdevice 102 can obtain the sequences of strings 216. In someimplementations, the client device 102 stores a local copy of thesequences of strings 216 in a database of the client device 102.

The methods illustrated in FIGS. 7-11 may be governed by instructionsthat are stored in a computer readable storage medium and that areexecuted by at least one processor of at least computer system (e.g.,the server 110, the client device 102). Each of the operations shown inFIGS. 7-11 may correspond to instructions stored in a non-transitorycomputer memory or computer readable storage medium. In variousimplementations, the non-transitory computer readable storage mediumincludes a magnetic or optical disk storage device, solid state storagedevices such as Flash memory, or other non-volatile memory device ordevices. The computer readable instructions stored on the non-transitorycomputer readable storage medium may be in source code, assemblylanguage code, object code, or other instruction format that isinterpreted and/or executable by one or more processors.

Plural instances may be provided for components, operations orstructures described herein as a single instance. Finally, boundariesbetween various components, operations, and data stores are somewhatarbitrary, and particular operations are illustrated in the context ofspecific illustrative configurations. Other allocations of functionalityare envisioned and may fall within the scope of the implementation(s).In general, structures and functionality presented as separatecomponents in the example configurations may be implemented as acombined structure or component. Similarly, structures and functionalitypresented as a single component may be implemented as separatecomponents. These and other variations, modifications, additions, andimprovements fall within the scope of the implementation(s).

It will also be understood that, although the terms “first,” “second,”etc. may be used herein to describe various elements, these elementsshould not be limited by these terms. These terms are only used todistinguish one element from another. For example, a first contact couldbe termed a second contact, and, similarly, a second contact could betermed a first contact, which changing the meaning of the description,so long as all occurrences of the “first contact” are renamedconsistently and all occurrences of the second contact are renamedconsistently. The first contact and the second contact are bothcontacts, but they are not the same contact.

The terminology used herein is for the purpose of describing particularimplementations only and is not intended to be limiting of the claims.As used in the description of the implementations and the appendedclaims, the singular forms “a”, “an” and “the” are intended to includethe plural forms as well, unless the context clearly indicatesotherwise. It will also be understood that the term “and/or” as usedherein refers to and encompasses any and all possible combinations ofone or more of the associated listed items. It will be furtherunderstood that the terms “comprises” and/or “comprising,” when used inthis specification, specify the presence of stated features, integers,steps, operations, elements, and/or components, but do not preclude thepresence or addition of one or more other features, integers, steps,operations, elements, components, and/or groups thereof.

As used herein, the term “if” may be construed to mean “when” or “upon”or “in response to determining” or “in accordance with a determination”or “in response to detecting,” that a stated condition precedent istrue, depending on the context. Similarly, the phrase “if it isdetermined (that a stated condition precedent is true)” or “if (a statedcondition precedent is true)” or “when (a stated condition precedent istrue)” may be construed to mean “upon determining” or “in response todetermining” or “in accordance with a determination” or “upon detecting”or “in response to detecting” that the stated condition precedent istrue, depending on the context.

The foregoing description included example systems, methods, techniques,instruction sequences, and computing machine program products thatembody illustrative implementations. For purposes of explanation,numerous specific details were set forth in order to provide anunderstanding of various implementations of the inventive subjectmatter. It will be evident, however, to those skilled in the art thatimplementations of the inventive subject matter may be practiced withoutthese specific details. In general, well-known instruction instances,protocols, structures and techniques have not been shown in detail.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific implementations. However, theillustrative discussions above are not intended to be exhaustive or tolimit the implementations to the precise forms disclosed. Manymodifications and variations are possible in view of the aboveteachings. The implementations were chosen and described in order tobest explain the principles and their practical applications, to therebyenable others skilled in the art to best utilize the implementations andvarious implementations with various modifications as are suited to theparticular use contemplated.

What is claimed is:
 1. A computer-implemented method for identifying anend of a television program, performed on a computing device having atleast one processor and memory storing at least one program forexecution by the at least one processor to perform the method,comprising: during a scheduled presentation of a television program,determining that the television program is within a first predeterminedtime interval including a time when the television program is scheduledto end; monitoring subtitles for the television program during the firstpredetermined time interval; and when a sequence of strings in thesubtitles corresponds to a known sequence of strings in an aggregationof subtitles indicating that the television program has ended, notifyingat least one electronic device that the television program has ended;wherein: the aggregation of subtitles includes known sequences ofstrings indicating that a respective television program in a pluralityof television programs has ended; and the known sequences of strings areobtained by: periodically obtaining subtitles for the plurality oftelevision programs during respective predetermined time intervals thatinclude respective times when respective television programs in theplurality of television programs are scheduled to end; identifyingsequences of strings from the subtitles for the plurality of televisionprograms in accordance with predefined criteria associated with theplurality of television programs; and updating the known sequences ofstrings in the aggregation of subtitles that indicate that a respectivetelevision program has ended with the identified sequences of strings.2. The computer-implemented method of claim 1, wherein monitoring thesubtitles for the television program during the first tpredeterminedtime interval includes: obtaining subtitles from a television signal onwhich the television program is being broadcast; and identifyingsequences of strings in the subtitles.
 3. The computer-implementedmethod of claim 2, wherein the subtitles for the television program areincluded in an image stream of the television signal, and whereinobtaining the subtitles from the television signal includes: obtainingimages from the image stream; and performing optical characterrecognition on the images to obtain the subtitles from the images. 4.The computer-implemented method of claim 2, wherein the subtitles forthe television program are included in a text stream of the televisionsignal, and wherein obtaining the subtitles from the television signalincludes extracting the subtitles from the text stream.
 5. Thecomputer-implemented method of claim 2, wherein the known sequence ofstrings in the aggregation of subtitles is stored in a database.
 6. Thecomputer-implemented method of claim 5, further comprising: providingthe at least one electronic device with access to the database.
 7. Thecomputer-implemented method of claim 1, wherein prior to determiningthat the television program is within a first predetermined timeinterval including the time when the television program is scheduled toend, the method includes: obtaining metadata for the television program;and determining the time when the television program is scheduled to endfrom the metadata for the television program.
 8. Thecomputer-implemented method of claim 1, wherein the at least oneelectronic device includes a set top box.
 9. The computer-implementedmethod of claim 1, wherein the at least one electronic device includes atelevision set.
 10. The computer-implemented method of claim 1, whereinthe at least one electronic device includes a computer system.
 11. Themethod of claim 1, wherein the sequences of strings in the aggregationof subtitles occur in at least a predetermined percentage of theplurality of television programs.
 12. The method of claim 1, whereinmonitoring subtitles for the television program during the predeterminedtime interval includes: comparing, on a periodical basis over thepredetermined time interval, the subtitles for the television programwith sequences of strings in the aggregation of subtitles associatedwith endings of a plurality of television programs.
 13. The method ofclaim 1, further comprising: preparing for presentation, on the at leastone electronic device, content related to the television program.
 14. Asystem to identify an end of a television program, comprising: at leastone processor; memory; and at least one program stored in the memory andexecutable by the at least one processor, the at least one programcomprising instructions to: during a scheduled presentation of atelevision program, determine that the television program is within afirst predetermined time interval including a time when the televisionprogram is scheduled to end; monitor subtitles for the televisionprogram during the first predetermined time interval; and when asequence of strings in the subtitles corresponds to a known sequence ofstrings in an aggregation of subtitles indicating that the televisionprogram has ended, notify at least one electronic device that thetelevision program has ended; wherein: the aggregation of subtitlesincludes known sequences of strings indicating that a respectivetelevision program in a plurality of television programs has ended; andthe known sequences of strings are obtained by: periodically obtainingsubtitles for the plurality of television programs during respectivepredetermined time intervals that include respective times whenrespective television programs in the plurality of television programsare scheduled to end; identifying sequences of strings from thesubtitles for the plurality of television programs in accordance withpredefined criteria associated with the plurality of televisionprograms; and updating the known sequences of strings in the aggregationof subtitles that indicate that a respective television program hasended with the identified sequences of strings.
 15. The system of claim14, wherein the instructions to monitor the subtitles for the televisionprogram during the first predetermined time interval includeinstructions to: obtain subtitles from a television signal on which thetelevision program is being broadcast; and identify sequences of stringsin the subtitles.
 16. The system of claim 15, wherein the subtitles forthe television program are included in an image stream of the televisionsignal, and wherein the instructions to obtain the subtitles from thetelevision signal include instructions to: obtain images from the imagestream; and perform optical character recognition on the images toobtain the subtitles from the images.
 17. The system of claim 15,wherein the subtitles for the television program are included in a textstream of the television signal, and wherein the instructions to obtainthe subtitles from the television signal include instructions to extractthe subtitles from the text stream.
 18. The system of claim 15, whereinthe known sequence of strings in the aggregation of subtitles is storedin a database.
 19. The system of claim 18, wherein the at least oneprogram includes instructions to provide the at least one electronicdevice with access to the database.
 20. The system of claim 14, whereinthe at least one program includes instructions to: obtain metadata forthe television program; and determine the time when the televisionprogram is scheduled to end from the metadata for the televisionprogram.
 21. The system of claim 14, wherein the at least one electronicdevice includes a set top box.
 22. The system of claim 14, wherein theat least one electronic device includes television set.
 23. The systemof claim 14, wherein the at least one electronic device includescomputer system.
 24. A non-transitory computer readable storage mediumstoring at least one program configured for execution by at least oneprocessor of a computer system, the at least one program comprisinginstructions to: during a scheduled presentation of a televisionprogram, determine that the television program is within a firstpredetermined time interval including a time when the television programis scheduled to end; monitor subtitles for the television program duringthe first predetermined time interval; and when a sequence of strings inthe subtitles corresponds to a known sequence of strings in anaggregation of subtitles indicating that the television program hasended, notify at least one client electronic device that the televisionprogram has ended; wherein: the aggregation of subtitles includes knownsequences of strings indicating that a respective television program ina plurality of television programs has ended; and the known sequences ofstrings are obtained by: periodically obtaining subtitles for theplurality of television programs during respective predetermined timeintervals that include respective times when respective televisionprograms in the plurality of television programs are scheduled to end;identifying sequences of strings from the subtitles for the plurality oftelevision programs in accordance with predefined criteria associatedwith the plurality of television programs; and updating the knownsequences of strings in the aggregation of subtitles that indicate thata respective television program has ended with the identified sequencesof strings.